Multi-touch Interactions for Model-based Sonification
نویسندگان
چکیده
This paper presents novel interaction modes for Model-Based Sonification (MBS) via a multi-touch interface. We first lay out details about the constructed multi-touch surface. This is followed by a description of the Data Sonogram Sonification Model and how it is implemented using the system. Modifications from the original sonification model such as the limited space scans are described and discussed with sonification examples. Videos showing examples of interaction are provided for various data sets. Beyond Data Sonograms, the presented system provides a basis for the implementation of known and novel sonification models. We discuss the available interaction modes with multi-touch surfaces and how these interactions can be profitably used to control spatial and nonspatial sonification models.
منابع مشابه
Surface Interactions for Interactive Sonification
This paper presents novel interaction modes for Model-Based Sonification (MBS) via interactive surfaces. We first discuss possible interactions for MBS on a multi-touch surface. This is followed by a description of the Data Sonogram Sonification and the Growing Neural Gas Sonification Model and their implementation for the multi-touch interface. Modifications from the original sonification mode...
متن کاملVOSIS: a Multi-touch Image Sonification Interface
VOSIS is an interactive image sonification interface that creates complex wavetables by raster scanning greyscale image pixel data. Using a multi-touch screen to play image regions of unique frequency content rather than a linear scale of frequencies, it becomes a unique performance tool for experimental and visual music. A number of image filters controlled by multi-touch gestures add variatio...
متن کاملTouching the Data: Exploring Data Sonification on Mobile Touchscreen Devices
This paper suggests using mobile touchscreen devices to assist students with vision loss in working with data. It presents an integrated approach that combines current sonification methods with interactive multi-touch gesture-based exploration of data, designed to aid students in mental visualization and comprehension of data and function plots. This approach aims to help students with vision l...
متن کاملModelling the Multi-Sensory Design Space
Research into the visualization of abstract data has resulted in a number of domain specific solutions as well as some more generic techniques for visualising information. Similarly, the field of sonification has explored the display of information to the human auditory sense. As haptic displays such as force-feedback devices become more readily available, the sense of touch is also being used ...
متن کاملInteractive Sonification of Curve Shape and Curvature Data
This paper presents a number of different sonification approaches that aim to communicate geometrical data, specifically curve shape and curvature information, of virtual 3-D objects. The system described here is part of a multi-modal augmented reality environment in which users interact with virtual models through the modalities vision, hearing and touch. An experiment designed to assess the p...
متن کامل